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Abstract. We define an integer valued invariant of homology spheres using 
the methods of SU (3) gauge theory and study its behavior under orientation 
reversal and connected sum. 



1. Introduction 

Any SU(n) generalization of the Casson invariant for homology 3-spheres X 
ought to be defined as a signed count of conjugacy classes of irreducible SU(n) 
representations of Tr%X. The difficulty is that, just as in the SU(2) case, one must 
perturb the space of representations to make it generic and hence finite, but for 
n > 2 the signed count depends on the perturbation. 

In H , Taubes introduced a technique for perturbing the flatness equations and 
gave a gauge-theoretic interpretation of Casson's SU (2) invariant as a signed count 
of gauge orbits of perturbed flat SU(2) connections on X. In an SU(3) Cas- 
son invariant Xsu(3) f° r homology 3-spheres X is defined using the perturbation 
approach of Taubes. For each generic perturbation h, an integer X' su ^(X,h) is 
defined as a signed count of gauge orbits of irreducible, /i-perturbed flat SU(3) 
connections, 

(1) y SU(3) (X,h)= £ (_1)"CM), 

[A]eM* h 

where AA* h is the moduli space of irreducible, /i-perturbed flat SU(3) connections, 
A is a representative for the gauge orbit [A] , and SF refers to the spectral flow of 
the odd signature operator K a acting on su(3)-valued forms. 

The resulting integer X' su ^ (X, h) is not independent of the choice of the pertur- 
bation h. To extract a topological invariant, one needs to define a correction term. 
An analysis of the parametrized moduli space corresponding to a path joining two 
generic perturbations suggests that the correction term should be a signed sum of 
the form 

(2) \ J2 (-if^SF^Ao^A), 

where Ai r h is the moduli space of reducible, /i-perturbed flat connections (i.e., with 
holonomy reducing to S(U(2) x U(l))) and Aq is some fixed reducible connection. 
Here, the subscript on SF t) ± indicates that the operator Ka is acting on forms 
with coefficients in f)- 1 , the orthogonal complement in su(3) of the Lie subalgebra 
f) = s(u(2) x u(l)). 

In Aq was taken to be 6, the trivial connection. Unfortunately, the quantity 
SFt ) ± (9, A) is not gauge invariant; it depends on the choice of representative A for 
the gauge equivalence class [A] . In , it was shown how to restore gauge invariance 
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by restricting to small perturbations and adding the Chern-Simons invariant of a 
flat connection A near the representative A to obtain the correction term: 

X'^ u(3) (X,h) = i Yl (-^ SF ^ A) (SF^(e,A)^4cs(A) + 2). 
[A]eM T h 

Then X SU ^{X) = X' su ^(X,h) + (X, h) is independent of the choice of 

small perturbation h. In the recent preprint Q], Cappell, Lee and Miller develop a 
different technique for correcting the gauge ambiguity in (|^). 

In this paper, we construct a correction term r"(X,h) like (||) but without any 
gauge ambiguity. Setting 

r(X) = \' sm3) (X,h)+r"(X,h) 

gives an integer valued SU(3) Casson invariant of homology 3-spheres. Like \su(3)i 
the invariant r enjoys properties (i) - (iii) of the following theorem, which is our 
main result. 



Theorem ^ The quantity t(X) is an integer valued invariant of homology 3- 
spheres. Furthermore, 

(i) Ifr(X) ^ 0, then there exists an irreducible representation p : -K\X — > SU(3). 

(ii) If X equals X with the orientation reversed, then t(X) — t(X). 

(iii) // X\ and X 2 are homology 3-spheres, then 
t(X 1 #X 2 ) = t(Xx) + r(X 2 ) + 4A SC/(2) (X 1 )A S[/(2) (X 2 ). 



The invariant r has numerous advantages over As;y(3), and we mention three. 
First, t(X) E Z. (A priori Xsu(3)(X) takes values in R, although the conjectured 
rationality of the Chern-Simons invariants would imply \su(3){X) £ Q.) Secondly, 
because Casson's invariant is a finite type invariant, one expects the same is true of 
the generalized Casson invariants. This is not the case for \su(3)i the computations 
in Q imply Xgij(^ is not a finite type invariant. Nevertheless, those same compu- 
tations support the conjecture that r is a finite type invariant. Thirdly and most 
importantly, r is easier to compute than Xsu(3) an d therefore seems more likely to 
satisfy a surgery formula. 

To illustrate this last point, we suppose that the moduli space M. of unper- 
turbed flat ST/ (3) connections on X is regular. This is equivalent to the topological 
assertion 

(*) H^(X; su(3)) = for all representations a : iriX — > SU(3). 

(For example, every Brieskorn sphere of the form S(2,p, q) satisfies (*).) If X 
satisfies (*), then X SU ^ 3 - ) (X) can be computed directly from M without resorting to 
the use of perturbations. (I.e., one can take h = 0.) In this case, the correction term 
^su(3) * s shnply a signed sum Atiyah-Patodi-Singer rho invariants, but computing 
X'gu^(X) is somewhat involved (cf. the computations in Q|). 

By contrast, whenever (*) holds the correction term t" vanishes. Hence, t(X) = 
^'su(3) (-^> 0) whenever M. is regular. This nice property of r holds in the more 
general situation of homology 3-spheres satisfying 



(**) H^(X; C 2 ) = for all representations a : mX -> SU{2). 
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The condition (**) implies that A' S£/ ^ 3 ^ (X, h) and X'gjj^ (X, h) are each independent 
of h small. In Lemma 0, we prove that, whenever (**) holds, r"(X,h) — and 
t(X) — X' SU ^(X, h) for h small. 

Of course, many homology 3-spheres fail to satisfy (**); examples include Brieskorn 
spheres of the form T,(p,q,r) with p,q,r > 2. Thus the integer \' SU ^(X, h) will 
generally depend on the choice of h. Nevertheless, t(X) agrees with X' SU ^(X, h) 
whenever the latter is independent of h. In this sense, r is a topological invariant of 
homology 3-spheres which accounts for gauge orbits of reducible connections only 
when absolutely necessary. 



Notation. Throughout this paper, X will be a homology 3-sphere, i.e., a closed, 
oriented 3-manifold satisfying Hi(X;Z) = Hi(S 3 ;7i). We denote by X the oppo- 
sitely oriented homology 3-sphere. 

Let \su(2) (^0 be Casson's original invariant, as normalized in ]To| (so \su(2) P0 S 
2Z), and \su{3)(X) be the invariant defined in H. 

For convenience, we use the notation for differential forms whereby f2 0+1 = f2° © 
fi 1 , and similarly for cohomology. Additionally, we use the shorthand h % = dimH 1 . 

Given a path K t , t 6 [0, 1] of operators with discrete, real spectrum, we denote by 
SF(K t ) the spectral flow of K t from t = to t = 1 using the (— e, — e) convention. 
Thus, SF(K t ) is the oriented intersection number in [0, 1] x R of the spectrum of 
K t with the horizontal line segment (t, — e), t 6 [0, 1] for all e > sufficiently small. 
With this convention, spectral flow is additive under composition of paths. 



2. Main results 

We begin with a review of 3-manifold SU (3) gauge theory. Let X be a homology 
sphere, P = X x SU(3), and 9 be the trivial (product) connection on P, with 
covariant derivative d. We denote the space of smooth SU (3) connections on P by 

A= {d + A | A 6 n\X;su(3))} 

and the gauge group of smooth bundle automorphisms by 

G = {g : X - SU(3)}. 

This group acts on A by d + A ^ d + gAg^ 1 + gdg^ 1 with quotient B = A/G, 
the space of gauge orbits. We refer to the connection d + A simply as A when no 
confusion can arise and use [A] to denote the G orbit of A £ A. 

Let Go be the identity component of G and set B = A/Go- Given A £ A, we 
denote its Go orbit by [A], Since Go is the kernel of deg : G —* Z (see Prop. 4.2 
in the natural projection B — > £> is a nontrivial connected Z-cover (in fact the 
universal cover). 

The Chern-Simons function cs : A — > M is defined by the formula 

csM) = At / ir(A A eL4 + \A A A A A). 

Since cs(<? • A) — cs(A) + deg(g), the Chern-Simons function is a well-defined R- 
valued function on B, whereas on B it takes values in M/Z. 

The situation for the spectral flow is similar. Choose a Riemannian metric on 
X. Let T denote the space of admissible perturbation functions (see for details). 
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To each pair (A, h) 6 A x T we associate a self- adjoint, Fredholm operator Ka.k 
on Q a+1 (X; su(3)) denned by the formula 

(3) Kam(£,, «) = {d* A a, gU£ + *d,Aa — 47r Hess h(A)a). 

If h = 0, then K A ,o = Ka is simply the odd signature operator coupled to the 
connection. If A is flat, then the Hodge and de Rham theorems identify kex Ka 
with the twisted cohomology H® +1 (X; su(3)), where a — hol A : tt\X — » SU(3) is 
the holonomy representation of A. Hereafter, this cohomology will be denoted by 
H A +1 (X; su(3)). More generally, when A is /i-perturbed flat, we can decompose 
keri^A,/i by degree and write 

kexK A>h = H A (X; au(3)) © H\ th (X; s«(3)). 

Note that su(3)) = ker(d A : su(3)) -> su(3)) is independent of 

h and can be identified with the Lie algebra of the stabilizer of A in Q. 

Given (A t , h t ), < t < 1, in A x J 7 , the spectral flow of the path of self-adjoint 
operators KA t ,h tl < t < 1, is an integer- valued invariant of the homotopy class 
of the path rel endpoints. We use the (— e, — e) convention throughout this article. 
Because A and J- are simply connected, this spectral flow depends only on the 
endpoints (Ao,ho) and (Ai,h{). 

To avoid cumbersome notation, we will adopt the following conventions. If A 
and A\ are flat connections, then SF(Ao,Ai) will always mean the spectral flow 
of KA t ,o for A t , t e [0,1] a path from Aq to A\. If Aq is flat (e.g. Aq is the 
trivial connection 6) and A\ is /i-perturbed flat for a fixed perturbation h, then 
SF(Aq, Ai) will always denote the spectral flow of KA t .h t for At, t € [0, 1] a path 
of connections from Ao to Ai and ht a path of perturbations from ho = to 
hi = h, i.e. the spectral flow of the path of self-adjoint operators from Ka ,q to 
Ka 1 ,h- In all other contexts the choice of the path ht will be specified (or obvious) 
and SF(Aq, A\) will denote the spectral flow of KA t ,h t - 

Given a connection A and a gauge transformation g, the index theorem implies 
that the spectral flow of Ka u o along a path A t from Aq = A to Ax = g ■ A equals 
12 deg g (for a demonstration of this, see ||). Thus the function A i— > SF(9, A) on 
connections descends to a well-defined function B — B x {0} — > Z or to a function 
B = £x {0}^Zi 2 . 

Let -F/i = dA + A A A be the curvature of the connection A and M. the moduli 
space of flat ST/(3) connections 

M = {A e A | F A = 0}/G. 

Note that M. is a compact subset of £> since it is homeomorphic to the space of 
conjugacy classes of SU(3) representations of ~k\X. Its preimage in A is precisely 
the set of critical points of the Chcrn-Simons function. Given an admissible per- 
turbation h (see Definition 2.1 of Q), a connection A is called h-perturbed flat if 
it is critical point of the function cs + h : A — > K. We denote the moduli space 
of /i-perturbed flat connections by M.h\ h is compact by Lemma 8.3 of ||. The 
moduli spaces of Go orbits of flat connections and /i-perturbed flat connections are 
denoted M and Mh- Since B — > B is a Z-cover, neither M nor TW^ is compact. 

Let T A = {g £ G \ g ■ A = A} be the isotropy group of A E A and define the 
subsets 



A* = {A e A\T a = Z 3 } and „4 r = {A e ^ | T A a [/(!)}, 
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of irreducible connections and reducible, nonabelian connections, respectively. Since 
X is a homology sphere, M decomposes as the disjoint union 

M = {[9}}UM r UM*. 

We denote by As(tj(2)xU(i)) the subset of A consisting of connections A whose 
holonomy reduces to the standard S(U(2) x U(l)) subgroup. For such connections, 
Ka,h acts diagonally with respect to the splitting 

(4) n 0+1 {X;su(3)) = n 0+1 (X;f))ffifi 0+1 (Z;F) X ) 

associated to the splitting su(3) — t) f)- 1 , where f) = s(u(2) x u(l j) and fy x = C 2 
is its orthogonal complement. For any A ,Ax £ A r , choose a path in A r between 
them (A r is path connected) and gauge transform so the path lies in As(u(2)xu(i))- 
Then the spectral flow splits according to the decomposition of (^) as 

SF(Ao,A!) = SFt,{A 0l A t ) + SF„± {A , A x ). 

If, in addition, A is ^.-perturbed flat, then we have decompositions 

H° A (X; su(3)) = H° A (X; f,) © H° A (X; f) X ), 
H\ th (X; su(3)) = H\ th {X; f>) © H\ h {X; f) X ). 
(In this case, it is not hard to show that H A (X; fj) = K and H A (X; J) x ) = 0.) 

Proposition 1. On any component C C A4 r , the function C — > Z defined by 
[A] I— > SFu±(9, A) is bounded above and below. 

Proof. Since the Chern-Simons function is constant on components of flat connec- 
tions and since cs : B — > R/Z classifies the Z-cover Z? — > S, it follows that M — > 
is the trivial Z-cover. Thus, every such C is a homeomorphic copy of a component 
of Ai r and is therefore compact. 

Choose [A] G A4 r . Then A is nonabelian, and we can assume after gauge trans- 
formation that A G As(u(2)xU(i))- The zeroth cohomology H A (X;su(3)) then 
consists of 0-forms which are constant diagonal matrices of the form 

to \ 
ia 
-2ia J 

In particular, this implies that H^X;^) = and H A (X is identified with 
the kernel of Ka,k acting on rj^-valued forms. 

Since the dimension of the kernel of a continuous family of Fredholm operators 
is upper semicontinuous, h A (X; t)- 1 ) is a bounded function on the compact set 
M r . Since we are using the (— e, — e) convention, it follows that every [A] G C is 
contained in a neighborhood U such that 

SF^ (9, A) - h\(X; r/) < SF^ (9, A') < SF h x {9, A) 

for all A 1 G U. Taking one such neighborhood for each \A\ G C gives an open 
covering of C. Using compactness to pass to a finite subcover, we conclude that the 
function \A\ ^ SF t) ±(6,A) is bounded above and below. □ 

For the remainder of this paper, we denote by C\, . . . , C n the connected compo- 
nents of M r and by U\, . . . ,U n disjoint open sets of B r = A r /Q with d C Ui for 
i = 1, ...n. Since the Chern-Simons function cs : B r — > K/Z is constant along the 
components Cj, we can choose U{ small enough so that cs(Ui) is a proper subset of 
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K./Z. This condition guarantees that the restriction of p : B r — ► B r to p _1 (C/i) is 
the trivial Z-cover. 

Proposition 3.7 of M insures that for h G T sufficiently small, we have M r h C 
UILi U%. If [Ao], [At] G [/,*, there is an unambiguous way to define f) 1 - spec- 
tral flow between them by choosing gauge representatives in the same compo- 
nent of p~ 1 (Ui). (Which component of p _1 (C/j) they lie in does not matter, since 
SF f) ±(Ao,Ai) = SF f) ±(g ■ Ao,g ■ Ai).) In this situation, we will call the represen- 
tatives Aq, A\ of [Aq], [Ai] compatible with one another. Any time we refer to t) ± 
spectral flow between nontrivial reducible connections, we assume the connections 
are compatible. 

Proposition 1 has the following consequence. 

Corollary 2. There exist [Af], [A~] G Cj, i = 1, . . . , n, such that for all [A] G C; 
and any mutually compatible representatives A,Af,A^, 

SF^(6,A)<SF^(9,A+), 

SF t) ± (6, Ar) — (X; f)- 1 ) < SF t) ± (9, A) — h\(X; t) ± ). 

□ 

For generic small h £ T, M.% is regular, i.e., for all [A] £ Mh the condition 
H\ h (X; su(3)) = holds. (See Section 3 of M for details.) Regularity implies that 
Aih consists of only finitely many points. 

Proposition 3. Suppose h is a small, generic perturbation. Define 

n 

t"(X, h) = | £ J2 (-ifmA) ( SF%± { Af, A ) 

»=1 [A]<EM r h nU z 

+SF^(Ar,A) + h\ T (X;t> x j) . 

Then r (X, h) is an integer and depends only on the perturbation h and the manifold 
X; in particulalr it is independent of the choice of Af . 

Proof. We first prove that t"(X, h) depends only on the perturbation h. Since we 
have already seen that the spectral flow terms are gauge invariant, we just need to 
show that t"(X, h) is independent of the choices of [Af], [A~] G C\ for i = 1, . . . , n. 
Suppose then that [Bf], [B~] e d also satisfy Corollary ||. Taking lifts Bf,B~ 
compatible with Af , Ar , it follows from additivity of spectral flow and Corollary || 
that 

SF^(Af,A) = SF^(Bf,A), 
SF^ (Ar,A) + h\. (X- f^) = SF^ (Br,A) + h 1 ^ (X; fr 1 ). 

for all A G A r . This shows t"(X, h) is independent of the choice of [Af], [Ar] G C,; 
satisfying Corollary ||. 

To show t"(X, h) G Z, we claim that 

(6) SF„± (Ar , A) + SF^ (A+,A) + h\- (X-^) 

is divisible by 4 for all [A] G B r . Additivity of the spectral flow gives that (|J) equals 

2SF h ± (A , A) - SF^ (Ar ,A+) + h\. (X; fr 1 ). 

We claim that each of these three terms is divisible by 4. 
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Divisibility of the first term follows because the Ta = 1/(1) action on fi 0+1 (X; fj- 1 ) 
gives rise to a complex structure with which KA t ,h t commutes for each t, where 
(A t ,h t ) is a path from (A^,0) to (A, h). This implies SF {J ±(A~,A) is even. 

Divisibility of the second and third terms is a consequence of the following claim. 

Claim. If Ai and A 2 are St/(2)x{l} connections, then SFu± (Ai,A 2 ) and h\.{X; I)- 1 ) 
are divisible by four. 

To see this, identify SU{2) with Sp(l), the unit quaternions, and t) 1 - = C 2 with 
H, the quaternions. The regular representation of ST/ (2) on C 2 can then be viewed 
as left multiplication in H, and it follows that right multiplication in H endows each 
eigenspace of Ka with a quaternionic structure. This proves the claim. □ 

The following theorem is our main result. 

Theorem 4. Suppose h is a small generic perturbation. Set 

r(X) = X' sui3) (X,h)+r"(X,h), 

where X' SU ^(X, h) is defined in equation ^) and t"(X,K) is given in Proposition 
|^. Then t(X) is an integer valued invariant of homology 3-spheres which agrees 
with X' su ^ on homology 3-spheres satisfying (**). Furthermore 

(i) Ifr(X) ^ 0, then there exists an irreducible representation p : n\X — > St/(3). 

(ii) t(X)=t(X). 

(iii) If X\ and X 2 are homology 3-spheres, then 
t(X 1 #X 2 ) = t(X x ) + t(X 2 ) + 4A SC/(2) (X 1 )A S[ /( 2) (X 2 ). 

3. Proofs 

Although it is possible to give a direct proof of Theorem ^ based on the arguments 
of ||, ||, it is in fact easier and more informative to study the difference between 
\su(3) an( i r - This is the approach we take in proving Theorem ^. The principal 
result is Lemma [| where we identify As;y(3) — r in terms of the following more 
general construction. 

Proposition 5. Recall that Ci, . . . , C n are the connected components of M. T with 
disjoint neighborhoods U\, . . . ,U n in B r . Given any a\, . . . ,a n G M, the quantity 

n 

(7) £ £ (-l)**^, 

i=l [A]£M r h nUi 

is independent of choice of generic small perturbation h. 

Proof. Notice that if ctfj = 1 for all i, the quantity (0) equals \su(2)(X) by The 
following argument is a simple generalization of that fact. 

Suppose p — h tl < t < 1, is a generic, 1-parameter family of perturbations. Let 

W P = |J M ht x {t} 

{£[0,1] 

be the parameterized moduli space. Recall that W r p is a smooth 1-manifold. If 
all the perturbations h t in the path are sufficiently small, then W r p C U™=i 
hence for each i = 1, . . . ,n, W r p fl Ui gives a 1-dimensional cobordism from M r ho n 
t/j to fl [/i with orientations given by the spectral flow. Thus each sum 

^2[A]eM^nUi(~ 1) SF 1S independent of h, which proves the proposition. □ 
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The numbers cti we use to analyze the difference \su(3) ~ T are easiest to describe 
in terms of the Atiyah-Patodi-Singer rho invariants. Since X is a homology 3- 
sphere, every [A] e M r can be represented by a flat SU{2) x {1} connection. 
Given such a connection A on X, the rho invariant of A with respect to the regular 
representation of SU(2) on C 2 can be defined by the formula (cf. Theorem 5.7, 



(8) g(A) = SF C 2 (6, A) - Acs{A) + 2 - \h\{X- C 2 ). 



Equivalently, we can replace C 2 coefficients by the subspace of su(3) which we have 
been denoting by f)^. The rho invariant g(A) depends only on the gauge orbit [A], 
not the representative. 

For i = l,... ,n, we define numbers 



- — { Q {A) + \h\{X;^)} 



<x = max 



(9) lA]eC > 

= r min { Q {A) - \h\{X-^)} 



It is often useful to let Co = { [6] } be the component containing the trivial connec- 
tion and to set at = = an . 



Remark. For each i = 1, ... ,n, the connection \Af\ can be characterized in a 
gauge invariant way as a global maximum point for the function d — > M defined 
by [A] I— > g(A) + hh\{X; f) x ). This follows by comparing equation (j|) and the 
inequalities (JsJ) since the Chern-Simons function is constant on path components 
of flat connections. Similarly, [A^] is a global minimum for the function d — > K 
defined by [A] i— > g>(A) — rj x ). Combining this observation with equations 



and (^) shows that 



a 



SF^(6,At)-4cs(A+) + 2, 



a- = SF^(e,Ar)-4cs(Ar) + 2-h\ r (X;t, ± ). 



Lemma 6. t(X) is a topological invariant of homology 3-spheres. 

Proof. Since invariance of A su(3) is proved in , we only need to prove that \su(3) ' 
t is independent of all choices made. Now 

X'^ u(a) (X,h) = i £ (-l) SF ^ A \SF^(e,A)-4cs(A) + 2), 
[a] eMj 
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where A is a reducible flat SU (3) connection close to A. Of course [A] £ Ci for 
some i, and making compatible choices for Af and A~ , we see that 

Asr/( 3 ) (X) - t(X) = \» u(3) (X, h) - r"(X, h) 

n 

= iE E (-l) SF ^(2SF f ,,{9,A)-8cs(A)+4 

i=l [A]eM£nE/ 4 

-SiV - SF„. (A~ , A) - ^_ (X; fr 

n 

= iE E (-i) Sir(9 ' A) -*»& + ) 

+5F 6 x (0, lr) - 4cs (lr) + 4 - h\_ {X- ^)) 

n 

= iE E (-i) SJ?(M) K + +«r)- 

The third step follows by additivity of the spectral flow together with the fact 
that cs(A) = cs(Af) = cs(A~), since the Chern-Simons function is constant along 
connected components of flat connections. Now letting aij = a~l + and applying 
Proposition || completes the proof. □ 

Lemma 7. If X satisfies (**), then t(X) equals X' SU ^(X, h) for any small generic 
perturbation h. 

Proof. We show that r"(X,h) — for sufficiently small h whenever (**) holds, 
i.e., whenever H\(X; f)- 1 ) = for all [A] € A4 r . This cohomology assumption 
implies H\ h (X; f)^) also vanishes for every [A] £ Ai r h for any small h. (Note that 
the assumption of smallness of h here is stronger than the assumption needed to 
define r.) Thus SF^(Af , A) = = SF t) ±(A~,A) and H\_ (X ; f)- 1 ) = for all 

[A] G M. r h H f/j. This shows that each summand in the definition of r"(X,h) 
vanishes for h sufficiently small. □ 

Lemma 8. t(X) = t(X). 

Proof. In pi, it is proved that X SU ^(X) — X SU ^(X). So, the lemma follows once 
we show that \su(3)(X) — t(X) satisfies the same formula. 

Reversing the orientation of X changes the sign of the Chern-Simons function but 
has no effect on the perturbations. Therefore, there is a natural correspondence 
between the flat moduli spaces Mh(X) and M-h(X). Obviously, if Mh(X) is 
regular, then so is Msu(3),-h(X)- 

The odd signature operator K Ah acts on SlP +1 (X; su(3)) by 



K x 



d* A 



oIa *oIa — 47r Hess h(A) 



Changing the orientation of X changes the sign of the Hodge star operator. Re- 
placing h by — h as well, we see that 



K x 



d* A 
oIa — * d-A + 47r Hess h(A) 
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Hence, if K* h (£,rj) = A(£, 77), then K A _ h {—^,rj) = — A(— £, rj). Thus switching ori- 
entations and replacing ft, by —ft, reflects the spectrum through zero. The following 
formula is a consequence of the (— e, — e) convention: 

SFx(KA u -h t ) = -SF x {K Auht ) + dimker KA lt hi - dimker K Ao , ho . 

Now suppose ft, is a small perturbation and Aih(X) is regular. If [A] G M. r h then 
H A {X; su(3)) R and H\ h {X; su(3)) = and so 

SF X (9,A) = -SF X (6,A) + 1-8. 

In this formula, on the left the spectral flow is taken from (9, 0) to (A, —ft), and on 
the right it is from (9, 0) to (A, ft). 

Further, if A is flat and reducible, then it is a simple exercise to prove Qx(A) = 
— qx{A). Equation then implies that 

af{X) = max i Qx {A) + \h\{X; t> X )\ 

[A]6C, L A > 

= max \-qx{A) + \K\{X-^)\ 
= - min { Qx (A) - \h\(X- [> x )} = -ar(X). 
Similarly a7(X) = -aj{X). Thus 

n 

X S u(3)(X)~r(X) = I£ J2 (-l) SF * i8 ' A) (at(X)+a7(X)) 

i=l [A]GM r _ h (X)nUi 
n 

= IE E (-i) Sf)[(M)+1 Km-^w) 

*=i [A]eXj(x)nc/< 
= A Sff (3)W-r(X). 

□ 

Lemma 9. If X\ and X2 are homology 3-spheres, then 

r(X x #X 2 ) = t(X 1 ) + t(X 2 ) + iX su(2) (X 1 )X su(2) (X 2 ). 

Proof. Since \su(3) was shown to satisfy a similar formula in || , it suffices to show 
additivity of \su(3) ~ T under connected sum. We first claim that the numbers af 
and a~ are additive under connected sum. 

To make this precise, we need to set up the notation. Set X = X\f^X 2 . Then 
every connection A on X is of the form A = Ai# a A 2 , where At is a connection on 
Xi and a is the gluing parameter. Furthermore, if A is reducible and flat, then so 
are A\ and A 2 . 

For k = 1,2, let Co(Xfc),... ,C nk (Xk) be the components of M r (Xk), where 
Co(Xk) = {[9 k]} is the component containing the trivial connection. The compo- 
nents of M. r (X) are then given by the sets 

CtjiX) = {[A = A x # a A 2 \ I A x G Ci(Xi) and A 2 e C (X 2 )}. 

for < i < ni and < j < n 2 . Note that Co,o(X) is now the component containing 
the trivial connection. For each we also choose an open set Uij(X) C B r (X) 
containing dj(X) so the collection {Uij(X) | < i < n%, < j < n 2 } is disjoint. 
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For k — 1,2 and i = 1, . . . , n k , let af (X k ) and a~ (X k ) be the quantities defined 
by equation @. Writing (X) and a^j (X) for same numbers defined with respect 
to the components Cij(X) for X = Xi#X 2 , we claim that 

at j (X)=a+(X 1 )+af(X 2 ), 

(10) 

ar j (X) = ar(X 1 ) + aJ(X 2 ). 

To see this, suppose A = Ai# a A 2 is a reducible flat connection. Adding a 
1-handle to (XiJjX 2 ) x [0,1] gives a flat cobordism from (X\, A\) U(X 2 , A 2 ) to 
(Xi#X 2 , A). Since this cobordism has no 2-handles, its signature and twisted 
signature vanish, and so the Atiyah-Patodi-Singer index theorem implies that 

(11) Qx 1# x 2 {A) = Q Xl {A l ) + qxAM)- 
In addition, the Mayer- Vietoris principle implies 

(12) H\{Xi#X 2] r/) = H\ x (Xf, f^) + H\ 2 {X 2 - fv 1 ). 

Equations (10) now follow by applying ([□]) and (|l2| ) above to the definition @. 

Suppose h k is a small admissible perturbation on Xk for k = 1,2, so that 
A4h k (Xk) is regular. Viewing hi and /12 as perturbations on X — Xi#X 2 , set 
ho — h% + h 2 and assume the perturbations are chosen small enough so that 
M r ho (X)c\J itj U itj (X). 

Given [A] € M. r h (X), we can write A = A\j^ a A 2 where A\ is an /ii-perturbed 
flat reducible connection on X\ and A 2 is an /12-perturbed flat reducible connection 
on X 2 . Then M r ho (X) consists of two types of components [gj: 

(i) SO (3) components of the form C = {[Ai# CTJ 4 2 ]}, where [A k ] 6 M r hk {X k ) for 
fc = 1, 2 and a is a gluing parameter with A\^ a A 2 reducible. 

(ii) Point components of the form C = {[6i^A 2 ]} or {[Ai#9 2 ]}, where 9 k is the 
trivial SU(3) connection over X k and [Ak] £ A4 1 hk (X k ) for fc = 1,2. 

Note that the intersection M. r ho (X) n Uij(X) consists entirely of components of 
type (i) unless i = or j = 0, in which case it consists of point components. 

We first argue that components of type (i) do not contribute to \su(3) (^0 — r (^0- 
To see this, suppose C is a component of type (i). Then C C Uij(X) for fixed 
i,j > 0. Let h = ho + tg be a perturbation so that the restriction of g to C is 
Morse. (The existence of such functions is shown in ||.) Then, for small t, the 
contribution of C to \su(3)(X) — T (A) is given by 

(af d {X) + ar d (X)) £ (-1)^1°), 

peCrit( ff |c) 

which vanishes since the sum evaluates to the Euler characteristic x(C) an( l C — 
50(3). (This is similar to the proof of Proposition 8 in 

Thus, dropping all the terms with i,j > from the following sum and 

applying equation ( ]To| ) to the remaining terms, we conclude that 
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X su{3) (X)-t(X) 

= lE E (-l) s ^^(at.(X) + ar.(X)) 

i,3 [A]eM;(X)nyij(X) 
"1 

= IE E {-if F *^>^ (atm+ctm) 

112 

+ I E E (-1)^.^) (at(X 2 ) + a 7(X 2 )) 

= -W( 3 )(Xi) - r (^l) + X S U(3)( X 2) - t(X 2 ). 

□ 

Since Xsu(2){X) G 2Z, Lemma ^| has the following corollary. 

Corollary 10. The mod 16 reduction ofr is additive with respect to connected sum 
of homology 3-spheres. □ 



Proof of Theorem y|. Lemmas [| and [?] show that t(X) determines an integer valued 
invariant of homology spheres X which agrees with X' SU ^(X) for homology 3- 
spheres satisfying (**). Part (i) of Theorem || follows since t(X) =/= implies 
the existence of an irreducible SU(2) or SU(3) representation of niX, but any 
irreducible SU(2) representation produces an irreducible SU(3) representation via 
mapping SU(2) — > 50(3) SU(3). Part (ii) follows from Lemma || and part (iii) 
from Lemma |9[ □ 
Below are some computations of t from [fjj. For these examples, observe that 
t(X) is divisible by 2. 



THE INVARIANT T FOR BRIESKORN SPHERES E(2,p, g) 



Brieskorn sphere 


The invariant t(X) 


E(2,3,6fc± 1) 


3k 2 ±k 


S(2, 5, lQJfc ± 1) 


33k 2 ± 9k 


E(2,5,10fc±3) 


33k 2 ± 19k + 2 


E(2,7,14fc±l) 


138fc 2 ± 26fc 


E(2,7,14fc±3) 


138fc 2 ± 62k + 4 


E(2, 7, 14fc ± 5) 


138fc 2 ± 102fc+ 16 


E(2,9,18Jfe± 1) 


390fc 2 ± 58fc 


E(2,9,18fc±5) 


390fc 2 ±210fc + 24 


E(2, 9, 18fc ± 7) 


390fc 2 ± 298fc + 52 



Concluding remarks and open questions. To better understand the relation- 
ship between Xsu(3) an d t, it is helpful to compare them to the SU (2) invariants Xw 
and A bn of rational homology spheres defined by Kevin Walker and by Boyer 
and Nicas ||, respectively. Under suitable hypotheses, the difference Xw — Xbn 
can be expressed as a sum of Atiyah-Patodi-Singer rho invariants of U(l) represen- 
tations ||. A similar statement is true of X S n^ — r, and so it is natural to ask 
whether r is the SU(3) analog of the Boyer-Nicas invariant. The answer is no, and 
we now explain why not. 
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The Boyer-Nicas approach works more generally for arbitrary compact Lie groups 
G. Their idea is to define a Casson-like invariant by incorporating only compact 
components of the variety of irreducible representations p : tt\X — > G. For that 
reason, no correction term is required. In the SU (3) case, their approach would 
yield an integer valued invariant that presumably agrees with r on homology 3- 
spheres satisfying (**). 

However, r and the SU (3) Boyer-Nicas invariant are not identical; r involves 
a correction term whereas the Boyer-Nicas invariant does not. In truth, r incor- 
porates contributions from the reducible components in only a very limited way. 
The proof of Lemma fj] shows that only those components of M r which contain 
gauge orbits [A] with H\(X; f) x ) ^ contribute to the correction term. These are 
precisely the components which, from first order considerations, may contain limit 
points of the irreducible stratum. The corresponding components of the irreducible 
stratum would therefore be excluded in the Boyer-Nicas approach on the grounds 
that it is not compact. This illustrates the fundamental difference between r and 
the SU(3) Boyer-Nicas invariant. 

We conclude this paper with five open problems. 

1. Is t(X) divisible by 2 for all homology 3-spheres? If not, is r mod 2 a 
homology cobordism invariant? 

2. Is r a finite-type invariant? 

3. Find a Dehn surgery formula for r. 

4. Compute r for homology spheres that do not satisfy (**), e.g., Brieskorn 
spheres S(p, q, r) with p, q, r > 2. 

5. Develop an SU(3) Floer theory and relate its Euler characteristic to r. 
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